The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: an analysis of MRCP(UK) examinations

Background: Cronbach's alpha is widely used as the preferred index of reliability for medical postgraduate examinations. A value of 0.8-0.9 is seen by providers and regulators alike as an adequate demonstration of acceptable reliability for any assessment. Of the other statistical parameters, Standard Error of Measurement (SEM) is mainly seen as useful only in determining the accuracy of a pass mark. However the alpha coefficient depends both on SEM and on the ability range (standard deviation, SD) of candidates taking an exam. This study investigated the extent to which the necessarily narrower ability range in candidates taking the second of the three part MRCP(UK) diploma examinations, biases assessment of reliability and SEM.Methods: a) The interrelationships of standard deviation (SD), SEM and reliability were investigated in a Monte Carlo simulation of 10,000 candidates taking a postgraduate examination. b) Reliability and SEM were studied in the MRCP(UK) Part 1 and Part 2 Written Examinations from 2002 to 2008. c) Reliability and SEM were studied in eight Specialty Certificate Examinations introduced in 2008-9.Results: The Monte Carlo simulation showed, as expected, that restricting the range of an assessment only to those who had already passed it, dramatically reduced the reliability but did not affect the SEM of a simulated assessment. The analysis of the MRCP(UK) Part 1 and Part 2 written examinations showed that the MRCP(UK) Part 2 written examination had a lower reliability than the Part 1 examination, but, despite that lower reliability, the Part 2 examination also had a smaller SEM (indicating a more accurate assessment). The Specialty Certificate Examinations had small Ns, and as a result, wide variability in their reliabilities, but SEMs were comparable with MRCP(UK) Part 2.Conclusions: An emphasis upon assessing the quality of assessments primarily in terms of reliability alone can produce a paradoxical and distorted picture, particularly in the situation where a narrower range of candidate ability is an inevitable consequence of being able to take a second part examination only after passing the first part examination. Reliability also shows problems when numbers of candidates in examinations are low and sampling error affects the range of candidate ability. SEM is not subject to such problems; it is therefore a better measure of the quality of an assessment and is recommended for routine use

Somatic activating mutations in Pik3ca cause sporadic venous malformations in mice and humans.

Venous malformations (VMs) are painful and deforming vascular lesions composed of dilated vascular channels, which are present from birth. Mutations in the TEK gene, encoding the tyrosine kinase receptor TIE2, are found in about half of sporadic (nonfamilial) VMs, and the causes of the remaining cases are unknown. Sclerotherapy, widely accepted as first-line treatment, is not fully efficient, and targeted therapy for this disease remains underexplored. We have generated a mouse model that faithfully mirrors human VM through mosaic expression of Pik3ca(H1047R), a constitutively active mutant of the p110α isoform of phosphatidylinositol 3-kinase (PI3K), in the embryonic mesoderm. Endothelial expression of Pik3ca(H1047R)resulted in endothelial cell (EC) hyperproliferation, reduction in pericyte coverage of blood vessels, and decreased expression of arteriovenous specification markers. PI3K pathway inhibition with rapamycin normalized EC hyperproliferation and pericyte coverage in postnatal retinas and stimulated VM regression in vivo. In line with the mouse data, we also report the presence of activating PIK3CA mutations in human VMs, mutually exclusive with TEK mutations. Our data demonstrate a causal relationship between activating Pik3ca mutations and the genesis of VMs, provide a genetic model that faithfully mirrors the normal etiology and development of this human disease, and establish the basis for the use of PI3K-targeted therapies in VMs.Postdoctoral fellowships were from EMBO (A LTF 165-2013) to S.D.C, EU Marie Curie (MEIF-CT-2005-010264) to E.T. and EU Marie Curie (PIIF-GA-2009-252846) to I.M.B. M.Z.-T. is supported by the EPSRC Early Career Fellowship of T.L.K. (EP/L006472/1). D.J.S. is a BHF Intermediate Basic Science Research Fellow (FS/15/33/31608). A.L.D is supported by the UK NIHR Joint UCL/University College London Hospitals Biomedical Research Centre. V.E.R.P. was supported by the Wellcome Trust (097721/Z/11/Z). R.K.S. is supported by the Wellcome Trust (WT098498), the Medical Research Council (M RC_MC_UU_12012/5). R.G.K. is supported by the NIHR Rare Diseases Translational Research Collaboration. V.W. is supported by the European FPVI Integrated Project ‘Eurostemcell’. M.F.L. and A.B. are supported by the King’s College London and UCL Comprehensive Cancer Imaging Centre CR-UK and EPSRC, in association with the MRC and DoH (England). W.A.P. is supported by funding from the National Health and Medical Research Council (NHMRC) of Australia. Work in the laboratory of M.G. is supported by research grants SAF2013-46542-P and SAF2014-59950-P from MICINN (Spain), 2014-SGR-725 from the Catalan Government, the People Programme (Marie Curie Actions) from the European Union's Seventh Framework Programme FP7/2007-2013/ (REA grant agreement 317250), the Institute of Health Carlos III (ISC III) and the European Regional Development Fund (ERDF) under the integrated Project of Excellence no. PIE13/00022 (ONCOPROFILE). Work in the laboratory of B.V. is supported by Cancer Research UK (C23338/A15965) and the UK NIHR University College London Hospitals Biomedical Research Centre.This is the author accepted manuscript. The final version is available from the American Association for the Advancement of Science via http://dx.doi.org/10.1126/scitranslmed.aad998

Anti-inflammatory and anti-invasive effects of α-melanocyte-stimulating hormone in human melanoma cells

Alpha-melanocyte stimulating hormone (alpha-MSH) is known to have pleiotrophic functions including pigmentary, anti-inflammatory, antipyretic and immunoregulatory roles in the mammalian body. It is also reported to influence melanoma invasion with levels of alpha-, beta- and gamma-MSH correlated clinically with malignant melanoma development, but other studies suggest alpha-MSH acts to retard invasion. In the present study, we investigated the action of alpha-MSH on three human melanoma cell lines (HBL, A375-SM and C8161) differing in metastatic potential. alpha-melanocyte-simulating hormone reduced invasion through fibronectin and also through a human reconstructed skin composite model for the HBL line, and inhibited proinflammatory cytokine-stimulated activation of the NF-kappaB transcription factor. However, A375-SM and C8161 cells did not respond to alpha-MSH. Immunofluorescent microscopy and Western blotting identified melanocortin-1 receptor (MC-1R) expression for all three lines and MC-2R on HBL and A375-SM lines. Receptor binding identified a similar affinity for alpha-MSH for all three lines with the highest number of binding sites on HBL cells. Only the HBL melanoma line demonstrated a detectable cyclic adenosine monophosphate (cAMP) response to alpha-MSH, although all three lines responded to acute alpha-MSH addition (+(-)-N(6)-(2-phenylisopropyl)-adenosine (PIA)) with an elevation in intracellular calcium. The nonresponsive lines displayed MC-1R polymorphisms (C8161, Arg (wt) 151/Cys 151; A375-SM, homozygous Cys 151), whereas the HBL line was wild type. Stable transfection of the C8161 line with wild-type MC-1R produced cells whose invasion was significantly inhibited by alpha-MSH. From this data, we conclude that alpha-MSH can reduce melanoma cell invasion and protect cells against proinflammatory cytokine attack in cells with the wild-type receptor (HBL).Journal ArticleResearch Support, Non-U.S. Gov'tSCOPUS: ar.jinfo:eu-repo/semantics/publishe

Ten-year mortality, disease progression, and treatment-related side effects in men with localised prostate cancer from the ProtecT randomised controlled trial according to treatment received

Background The ProtecT trial reported intention-to-treat analysis of men with localised prostate cancer randomly allocated to active monitoring (AM), radical prostatectomy, and external beam radiotherapy. Objective To report outcomes according to treatment received in men in randomised and treatment choice cohorts. Design, setting, and participants This study focuses on secondary care. Men with clinically localised prostate cancer at one of nine UK centres were invited to participate in the treatment trial comparing AM, radical prostatectomy, and radiotherapy. Intervention Two cohorts included 1643 men who agreed to be randomised and 997 who declined randomisation and chose treatment. Outcome measurements and statistical analysis Analysis was carried out to assess mortality, metastasis and progression and health-related quality of life impacts on urinary, bowel, and sexual function using patient-reported outcome measures. Analysis was based on comparisons between groups defined by treatment received for both randomised and treatment choice cohorts in turn, with pooled estimates of intervention effect obtained using meta-analysis. Differences were estimated with adjustment for known prognostic factors using propensity scores. Results and limitations According to treatment received, more men receiving AM died of PCa (AM 1.85%, surgery 0.67%, radiotherapy 0.73%), whilst this difference remained consistent with chance in the randomised cohort (p = 0.08); stronger evidence was found in the exploratory analyses (randomised plus choice cohort) when AM was compared with the combined radical treatment group (p = 0.003). There was also strong evidence that metastasis (AM 5.6%, surgery 2.4%, radiotherapy 2.7%) and disease progression (AM 20.35%, surgery 5.87%, radiotherapy 6.62%) were more common in the AM group. Compared with AM, there were higher risks of sexual dysfunction (95% at 6 mo) and urinary incontinence (55% at 6 mo) after surgery, and of sexual dysfunction (88% at 6 mo) and bowel dysfunction (5% at 6 mo) after radiotherapy. The key limitations are the potential for bias when comparing groups defined by treatment received and changes in the protocol for AM during the lengthy follow-up required in trials of screen-detected PCa. Conclusions Analyses according to treatment received showed increased rates of disease-related events and lower rates of patient-reported harms in men managed by AM compared with men managed by radical treatment, and stronger evidence of greater PCa mortality in the AM group. Patient summary More than 95 out of every 100 men with low or intermediate risk localised prostate cancer do not die of prostate cancer within 10 yr, irrespective of whether treatment is by means of monitoring, surgery, or radiotherapy. Side effects on sexual and bladder function are better after active monitoring, but the risks of spreading of prostate cancer are more common

Age-related immune response heterogeneity to SARS-CoV-2 vaccine BNT162b2

Abstract: Although two-dose mRNA vaccination provides excellent protection against SARS-CoV-2, there is little information about vaccine efficacy against variants of concern (VOC) in individuals above eighty years of age1. Here we analysed immune responses following vaccination with the BNT162b2 mRNA vaccine2 in elderly participants and younger healthcare workers. Serum neutralization and levels of binding IgG or IgA after the first vaccine dose were lower in older individuals, with a marked drop in participants over eighty years old. Sera from participants above eighty showed lower neutralization potency against the B.1.1.7 (Alpha), B.1.351 (Beta) and P.1. (Gamma) VOC than against the wild-type virus and were more likely to lack any neutralization against VOC following the first dose. However, following the second dose, neutralization against VOC was detectable regardless of age. The frequency of SARS-CoV-2 spike-specific memory B cells was higher in elderly responders (whose serum showed neutralization activity) than in non-responders after the first dose. Elderly participants showed a clear reduction in somatic hypermutation of class-switched cells. The production of interferon-γ and interleukin-2 by SARS-CoV-2 spike-specific T cells was lower in older participants, and both cytokines were secreted primarily by CD4 T cells. We conclude that the elderly are a high-risk population and that specific measures to boost vaccine responses in this population are warranted, particularly where variants of concern are circulating

Single-cell multi-omics analysis of the immune response in COVID-19

Funder: Lister Institute of Preventive Medicine; doi: https://doi.org/10.13039/501100001255Funder: University College London, Birkbeck MRC Doctoral Training ProgrammeFunder: The Jikei University School of MedicineFunder: Action Medical Research (GN2779)Funder: NIHR Clinical Lectureship (CL-2017-01-004)Funder: NIHR (ACF-2018-01-004) and the BMA FoundationFunder: Chan Zuckerberg Initiative (grant 2017-174169) and from Wellcome (WT211276/Z/18/Z and Sanger core grant WT206194)Funder: UKRI Innovation/Rutherford Fund Fellowship allocated by the MRC and the UK Regenerative Medicine Platform (MR/5005579/1 to M.Z.N.). M.Z.N. and K.B.M. have been funded by the Rosetrees Trust (M944)Funder: Barbour FoundationFunder: ERC Consolidator and EU MRG-Grammar awardsFunder: Versus Arthritis Cure Challenge Research Grant (21777), and an NIHR Research Professorship (RP-2017-08-ST2-002)Funder: European Molecular Biology Laboratory (EMBL)Abstract: Analysis of human blood immune cells provides insights into the coordinated response to viral infections such as severe acute respiratory syndrome coronavirus 2, which causes coronavirus disease 2019 (COVID-19). We performed single-cell transcriptome, surface proteome and T and B lymphocyte antigen receptor analyses of over 780,000 peripheral blood mononuclear cells from a cross-sectional cohort of 130 patients with varying severities of COVID-19. We identified expansion of nonclassical monocytes expressing complement transcripts (CD16+C1QA/B/C+) that sequester platelets and were predicted to replenish the alveolar macrophage pool in COVID-19. Early, uncommitted CD34+ hematopoietic stem/progenitor cells were primed toward megakaryopoiesis, accompanied by expanded megakaryocyte-committed progenitors and increased platelet activation. Clonally expanded CD8+ T cells and an increased ratio of CD8+ effector T cells to effector memory T cells characterized severe disease, while circulating follicular helper T cells accompanied mild disease. We observed a relative loss of IgA2 in symptomatic disease despite an overall expansion of plasmablasts and plasma cells. Our study highlights the coordinated immune response that contributes to COVID-19 pathogenesis and reveals discrete cellular components that can be targeted for therapy